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PHASE-LOCKED LOOP OSCILLATORY NEUROCOMPUTER 



The present patent application claims priority rights on U.S. Provisional Patent 
Application Serial No. 60/178,640 filed January 28, 2000. 
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FIELD OF THE INVENTION 
The present invention relates, in general, to computational devices and, more 
particularly, to a recurrent neural network computer based on phase modulation of Phase-Locked 
Loop (PLL) nonUnear oscillators. 

10 

BACKGROUND OF THE INVENTION 
Neural network computers, are biologically inspired, that is, they are composed of 
elements that perform in a manner analogous to the most elementary functions of the biological 
neuron. In one methodology, a neural network computer is composed of a number (n) of 

1 5 processing elements that may be switches or nonlinear amplifiers. These elements are then 
organized in a way that may be related to the anatomy of the brain. The configuration of 
connections, and thus communication routes, between these elements represents the manner in 
which the neural network computer will function, analogous to that of a program performed by 
digital computers. Despite this superficial resemblance, such artificial neural networks exhibit a 

20 surprising number of the brain's characteristics. For example, they leam fi:om experience, 
generalize fi'om previous examples to new ones, and abstract essential characteristics fi-om 
inputs containing irrelevant data. Unlike a von Neumann computer, such a neural network 
computer does not execute a list of commands (a program). Rather, it performs pattem 
recognition and associative recall via self-organization of connections between elements. 

25 Artificial neural networks can modify their behavior in response to their environment. 

Shown a set of inputs (perhaps with desired outputs), they self-adjust to produce consistent 
responses. A network is trained so that application of a set of inputs produces the desired (or at 
least consistent) set of outputs. Each such input (or output) set is referred to as a vector. 
Training can be accomplished by sequentially applying input vectors, while adjusting network 

30 weights according to a predetermined procedure, or by setting weights a priori. During training, 
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the network weights gradually converge to values such that each input vector produces the 
desired output vector. 

Because of their ability to simulate the apparently oscillatory nature of brain neurons, 
oscillatory neural network computers are among the more promising types of neiiral network 
5 computers. Simply stated, the elements of an oscillatory neural network computer consist of 
oscillators rather than amplifiers or switches. Oscillators are mechanical^ chemical or electronic 
devices that are described by an oscillatory signal (periodic, quasi-periodic, almost periodic 
function, etc.) Usually the output is a scalar flmction of the form V(a)t+(t)) where V is a fixed 
wave form (sinusoid, saw-tooth, or square wave), © is the frequency of oscillation, and ^ is the 

1 0 phase deviation (lag or lead). 

Recurrent neural networks have feedback paths from their outputs back to their inputs. 
The response of such networks is dynamic in that after applying a new input, the output is 
calculated and fed back to modify the input. The output is then recalculated, and the process is 
repeated again and again. Ideally, successive iterations produce smaller and smaller output 

15 changes until eventually the outputs become steady oscillations or reach a steady state. 

Although these techniques have provided a means for recognizing signals, to date they have not 
been able to do so using associative memory. 

Accordingly, a need exists for a neural network computer with fully recurrent 
capabilities and a method that incorporates the periodic nature of neurons in the pattern 

20 recognition process. 

SUMMARY OF THE INVENTION 

Li accordance with the present invention, an oscillatory neural network computer is 
25 disclosed that exhibits pattem recognition using the phase relationships between a learned 
pattern and an incoming pattern, i.e., the pattem to be recognized. 

In one aspect of the present invention, the oscillatory neural network computer comprises 
a weighting circuit having phase-based connection strengths. A plurahty of phase-locked loop 
circuits are operably coupled to the weighting circuit. 
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In another aspect of the present invention, a method for programming an oscillatory 
neural network computer is provided wherein programming comprises encoding connection 
coefficients of the oscillatory neural network computer in accordance with phase relationships 
of a pattern to be learned. 
5 In yet another aspect of the present invention, a method for recognizing an incoming 

pattern using an oscillatory neural network computer is provided wherein the method 
comprises using the phase deviation between a learned pattern and the incoming pattern to 
create an output signal indicative of the learned pattern. 

1 0 BRIEF DESCRIPTION OF THE DRAWING 

FIG. 1 schematically illustrates an oscillatory neural network computer in accordance 
with an embodiment of the present invention; 

FIG. 2 schematically illustrates a weighting element in accordance with an 
embodiment of the present invention; 
15 FIG. 3 illustrates patterns to be memorized by the oscillatory neural network computer; 

FIG. 4 illustrates a pattern to be recognized in accordance with an embodiment of the 
present invention; 

FIG. 5 is a plot of the frequency and the phase portions of output signals of the 
oscillatory neural network computer in accordance with the present invention; 
20 FIG. 6 is a plot of the frequency and the phase portions of other output signals of the 

neural network computer in accordance with the present invention; 

FIG. 7 illustrates the output signals to the pixels during the recognition process in 
accordance with the present invention; and 

FIG. 8 illustrates the products of the output signals to the pixels of FIG. 7. 

25 

DETAILED DESCRIPTION 



The oscillatory neural network computer of the present invention learns or memorizes 
information in terms of periodic waveforms having an amplitude, a frequency, and a phase. 
30 This information is encoded as connection strengths, Sy, using a learning rule such as, for 
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example, the Hebbian learning rule. The connection strengths, in combination with phase- 
locked loop circuitry, are used to recognize information from signals transmitted to the 
oscillatory neural network computer. 

Copending U.S. patent apphcation Serial No. PCT/US99/26698, entitled 
5 "OSCILLATORY NEUROCOMPUTER WITH DYNAMIC CONNECTIVITY" and filed 
November 12, 1999 by Frank Hoppensteadt and Eugene Izhikevich is hereby incorporated 
herein by reference in its entirety. 

FIG. 1 schematically illustrates an oscillatory neural network computer 20 in 
accordance with an embodiment of the present invention. Oscillatory neural network 

10 computer 20 comprises a weighting network 21 coupled in a feedback configuration to a 
plurality of phase-locked loop circuits 25i, . . 25^.u 25n. Oscillatory neural network 
computer 20 has output terminals OUTi, OUT2, . . OUT^.j, OUT^ for transmitting output 
signals V(eO, V(02), . . VCGn-O, V(Q^X respectively, where the output signals V(0O. V(92), . . 
V(9n-i)j V(9n) have equal firequencies and constant, but not necessarily zero, phase 

15 relationships. More particularly, weighting network 21 includes a plurality Cu, Ci,2> . - Cn,n 
of weighting circuits, a plurality 3 1 1, . . , , 3 l>j of adder circuits, and a plurality 35i, ...,35>^of 
bandpass filter circuits. Weighting circuits C^i, Ci,2, . . Ck,n are configured as an N x N 
matrix. By way of example, weighting network 21 is a symmetric matrix of weighting circuits 
where each weighting element is coupled for transmitting an output signal having a 

20 conaiection strength, Skj, associated therewith. The connection strength is also referred to as 
the connection weight, the connection coefficient, the interunit connection strength, or simply 
the strength or weight. It should be understood that reference number 25 is used to 
collectively identify the plurality of phase-locked loop circuits, reference number 31 is used to 
collectively identify the plurality of adder circuits, and reference number 35 is used to 

25 collectively identify the plurality of bandpass filter circuits. The subscript notation (1,2,..., 
N) has been appended to reference numbers 25, 3 1, and 35 to identify individual phase-locked 
loop circuits, adder circuits, and bandpass filter circuits, respectively. Further, the weighting 
circuits may also be referred to as connectors or weighting elements. 

Weighting circuits dj, Ci^2? • • Ci,N-b Ci,n are connected to the input terminals of 

30 adder circuit 31 1 and to the respective output terminals OUTi, OUT2, . . OUTn-u OUTn. 
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Weighting circuits C^u Cz,!, . . C2.N-b C2,n are connected to the input terminals of adder 
circuit 3I2, to the input terminals of the respective weighting elements Ci,25 Ci,n-i, Ci,n 
and to the respective output terminals OUTi, OUT2, . . OUTN-b OUTn- Weighting circuits 
Cn-i,!, Cw-uN-b Cn-i,n are connected to the input terminals of adder circuit 31n-i and to 

5 the respective output terminals OUTi, OUT2, . . OUTn-u OUTn, Weighting circuits Cn,!, 
Ch2j C^N-h Cn,n are connected to the input terminals of adder circuit 3 In and to the 
respective output terminals OUTi, OUT25 . . OUT^.b OUTn. 

Further, initialization input terminals INi, IN2, . . INn-i, INn are coupled to 
initialization input terminals of adder circuits 31]^ 3I2, . . Sl^-b 31^, respectively. The output 

1 0 terminals of adder circuits 3 1 1, 3 12, . . 3 iN-b 3 In are connected to the input terminals of 
bandpass filter circuits 35i, 352, . . 35N.b 35n5 respectively. 

The output terminals of bandpass filter circuits 35b 352, . . 35N-b 35n are connected to 
the input terminals of phase-locked loop circuits 25x, 250, . . 25N-b 25^, respectively. The 
output terminals of phase-locked loop circuits 25i, 252, • • 25N-b 25n are connected to the 

15 respective output terminals OUTi, OUT2, . . OUTn-i? OUTn- 

FIG. 2 schematically illustrates an embodiment of a weighting circuit (Ci,b C^, . . 
Cn,n) in accordance with the present invention. In this embodiment, weighting circuits Ci,i, 
Ci,2, - .5 Cn,n comprise a linear amplifier 23 having an input terminal connected to a respective 
ou^ut terminal OUTi, OUT2, OUTn-i, OUTn. An output terminal of linear amphfier 23 is 

20 connected to an input terminal of phase shift circuit 24. An output terminal of phase shift 
circuit 24 is connected to a corresponding adder circuit 31. The output signal appearing on 
the output terminal of phase shift circuit 24 is given by: 

v(e)-s,/v(e + x};,,) (1) 

25 

where 

Sicj is the connection strength (gain) of weighting circuit Ckj provided by linear 
amplifier 23; and 

is the phase shift introduced by phase shift circuit 24. 

30 
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Referring to FIGS. 1 and 2, PLL neural network 20 is a dynamic system that is 
described mathematically as 

de,(t)/dt^Q + V(9,)2; S^'*^V(ej.7r/2) (2) 

for k=l,,..5N, where: 
5 9 k is the phase of the VCO embedded in the PLL circuit; 

9 J is the phase of the VCO embedded in the j*^ PLL circuit; 
D is the natural frequency of the VCO in MegaHertz (MHz); 
Skj are the connection strengths; and 
V(9) is a 2n periodic waveform function. 
10 PLL neural network computer 20 has an arbitrary waveform function, V, that satisfies 

"odd-even" conditions and if connection strengths Skj are equal to connection strengths Sj^k for 
all k and j, then the network converges to an oscillatory phase-locked pattern, i.e., the neurons 
or phase-locked loop circuits oscillate with equal frequencies and constant, but not necessarily 
zero, phase relationships. Thus, the phase relationships between the oscillators can be used to 
1 5 determine the connection strengths of a neural network computer. 

An example of using phase relationships to train neural network computer 20 is 
described with reference to FIGS. 1, 2, and 3. FIG. 3 illustrates three pattems to be 
memorized that correspond to the images or symbols "0", "1", and "2," and which are 
identified by reference numbers 41, 42, and 43, respectively. The phase relationships of a set 
20 of key vectors (^"') or pattems of the images are initially memorized using a well knovm 
learning rule such as, for example, the Hebbian learning rule. (Other suitable learning rules 
include the back propagation learning rule, the template learning rule, the least squares 
leaming rule, the correlation learning rule, the perceptron leaming rule as well as other 
supervised and nonsupervised leaming mles). In accordance with the Hebbian leaming rale, 
25 the images are described as a set of key vectors: 

^--(^-„^^...,^-h), ^\=±l, m=0,...,r,andk-l,...,N (3) 
where 

m identifies the pattern to be memorized; 
r+1 is the number of pattems to be recognized; and 
30 N is the number of phase-locked loop circuits, i.e., the number of neurons. 
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Still referring to FIG. 3, patterns "0", "1", and "2" are partitioned into sixty (N=60) 
pixels or subimits. Pi, P2, . . Peo? which are described by key vectors respectively, 
which key vectors are to be memorized or recognized by oscillatory neural network computer 
5 20. For the image or symbol "1," ^\ is the vector component of the first pixel, Pf, is the 
vector component of the second pixel, P2; ^\is the vector component of the third pixel, P3; 
is the vector component of the fourth pixel, P4, etc. It should be noted that in this example, 
vector component describes a white pattern, vector component describes a white pattern, 
vector component describes a black pattern, vector component describes a black pattern, 

1 0 etc. Key vectors are also determined for the images "0" and "2." When ^\ = ^"'j, the k*^ and 
the oscillators are in phase, i.e., cpk = % and when ^\ the k* and the j"*" oscillators are 
anti-phase, i.e., (p^ = (pj+ tt. It should be noted that the number of pixels into which the 
images are partitioned is not a limitation of the present invention. 

The key vectors are used in conjunction with the learning rule to determine the 

15 connection coefficients of oscillatory neural network computer 20. In the example of using 
the Hebbian learning rule to memorize the images, the connection coefficients, Skj, are given 
by: 

S,, = (l/n)2 (3) 

m=0 

20 An advantage of using the Hebbian learning rule to determine the coimection 

coefficients is that it produces symmetric connections S]y so that the network always 
converges to an oscillatory phase-locked pattern, i.e., the neurons oscillate with equal 
frequencies and constant, but not necessarily zero, phase relations. It should be tmderstood 
that some information about each memorized image is included in each connection 

25 coefficient. 

After the initial strengths are memorized, neural network computer 20 is ready for 
operation, which operation is described with reference to FIGS. 1-8. 

FIG. 4 illustrates a pattern 44 to be recognized which is a degraded or distorted version 
of the image "1" illustrated in FIG. 3 and previously memorized. In operation, the pattern to 
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be recognized, i.e., pattern 44, is parsed into a desired nximber of pixels. Each pixel will 
correspond to a PLL circuit. Each PLL circuit is the equivalent of a neuron, in our use of the 
term. In the example shown in FIGS. 4-8 pattern 44 is parsed into sixty pixels, Pi-Peo- Thus, 
oscillatory neural network computer 20 will contain sixty PLL circuits, 25r256o. At time t=0, 
5 oscillatory neural network computer 20 is initialized such that the initial signals on PLL 
circuits 25r256o represent degraded pattern 44. Byway of example, PLL circuits 25r256o are 
initialized by applying an external signal at input terminals BSTi, . . INn of the form: 
Ik(t)-AkCOs(Qt + (i)o) (4) 

for k=l,...,60, where: 
10 Q is the same as the center frequency of the PLL; 

(j)o is an arbitrary constant; 

Ak are large numbers that are positive if the input for the k'^ channel is to be initialized 
at +1 and are negative if the k*^ channel is to be initialized at a - L 

After an initialization interval, the external inputs are turned off and the network 
1 5 proceeds to perform its recognition duties. 

Another suitable method for initializing neural network computer 20 is to start the PLL 
circuits of PLL 25 such that they have different phases that represent pattem 44. Yet another 
suitable method is to start the PLL circuits of PLL 25 such that they have the same phase and 
then shift the phase in accordance with pattem 44. Yet another suitable method is to set the 
20 initial voltages of the loop filters associated with each PLL circxiit of PLL 25. It should be 
understood that the method for initializing oscillatory neural network computer 20 is not a 
limitation of the present invention. 

Still referring to FIG. 4, at time t=0, pattem 44 is such that the image or value for the 
pixel Pi associated with key vector B,\ is white, the image or value for the pixel P2 associated 
25 with key vector is black, the image or value of the pixel P3 associated with key vector is 
black, the image or value of the pixel P4 associated with key vector ^\ is white, the image or 
value of the pixel P5 associated with key vector is white, the image or value of the pixel Pe 
associated with key vector is white, the image or value of the pixel P7 associated with key 
vector is white, the image or value of the pixel Pg associated with key vector ^\ is black, 
30 . . the image or value of the pixel V^o associated with key vector ^^o is black. It should be 
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understood that the superscripted number 1 indicates this is the phase pattern being 
recognized, as opposed to a "0" or a "2." 

FIG. 5 is a plot 50 of the frequency 51 and the phase 52 portions of output signals, 
¥(90 and ¥(62), of PLL circuits 25i and 25., respectively, (FIG. 1). At time t=0, the 
5 amplitude of output signal V(9i) is +1 and the phase 91 is approximately 120 degrees (27t/3) 
which corresponds to the white image associated with key vector whereas at time t=0 the 
amplitude of output signal V(92) is -1 and the phase 92 is approximately 0 degrees which 
corresponds to the black image associated with key vector ^^2. 

FIG. 6 is a plot 55 of the frequency 56 and the phase 57 portions of output signals, 

10 V(0O and ViQs), of PLL circuits 25i and 253, respectively, (FIG. 1). At time t-0, the 

amphtude of output signal V(9i) is +1 and the phase (pi is approximately 120 degrees {2n/3) 
which corresponds to the white image associated with key vector whereas at time t=0 the 
amplitude of output signal V(93) is -1 and the phase 93 is approximately 0 degrees which 
corresponds to the black image associated with key vector ^^3. 

1 5 Although not shown, it should be understood that there are corresponding output 

signals V(04), . . ., V(96o) that occur for each of the respective PLL circuits 254, .... 256o. 

Plots 50 and 55 ftirther illustrate pattern recognition in accordance with an 
embodiment of the present invention. Because the patterns of the individual pixels that have 
been leamed are either black or white, output signals V(9i), . . V(06o) lock in phase or in anti- 

20 phase to each other depending on the pattern being recognized. For example, in the pattern 
for a "1" (FIG. 3) pixels Pi, P2, P5, and P^ are white and pixels P3 and P4 are black. Thus, when 
this pattern is recognized from pattem 44, PLL circuits 25 1, 252, 255, and 25^ should lock in 
phase to each other and PLL circuits 253 and 254 should lock in phase to each other. Further, 
the PLL circuits for pixels that are of opposite color should lock in anti-phase to each other, 

25 i.e., pixels that are white should lock in anti-phase or out of phase to pixels that are black. 
This is illustrated for PLL circuits 25 1 and 252 in FIG. 5 and for PLL circuits 25 1 and 253 in 
FIG. 6. Referring to FIG. 5, output signals V(9i) and V(92) have a substantially constant in- 
phase relationship to each other by time t==8.0, i.e., the difference in their phases (91-92) is less 
than 30 degrees. It should be understood that an acceptable error value for the phase 

30 difference of a signal locked in-phase is a design choice. It should be further understood that 
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the units for time are not included for the sake of clarity. Thus, the units for the time may be 
seconds, milliseconds, microseconds, etc. 

Briefly referring to FIG. 6, output signals V(9i) and ¥(63) have a substantially constant 
anti-phase relationship to each other by time t=8.0, i.e., the difference in their phases (91-93) is 

5 greater than approximately 150 degrees. It should be understood that an acceptable error 
value for the phase difference of a signal locked in anti-phase is a design choice. 

FIG, 7 illustrates the visual outputs for pixels Pi, . . Peo from time t=8.0 to time t=9.2. 
At times t=8.0, 8.6, and 9.2, pixels Pi and P2 are white, whereas at times t=8.3, 8.9, and 9.5 
pixels Pi and P2 are black. It is expected that at times t^B.O, 8.6, and 9.2, the output signals 

1 0 for pixels Pi and P2 would have substantially the same amplitude and polarity and be in phase 
and at times t=8.3, t=8.9, and t=9.5, the output signals for pixels Pi and P2 would have 
substantially the same amplitude and polarity and be in phase. Comparing these times with 
the output signals shown in FIG. 5, at times t=8.0, t=8.6, and t=9.2 output signals ¥(61) and 
V(02) have an amplitude of +1 and are substantially in phase. Likewise, at times t=8.3, t=8.9, 

15 and t=9.5 output signals V(0i) and ¥(82) have an amphtude of -1 and are substantially in 
phase. 

Further, it is expected that at times t=8.0, 8.3, 8.6, 8.9, 9.2, and 9.5, the output signals 
for pixels Pi and P3 would be in anti-phase and have amplitudes of substantially the same 
magnitude but opposite polarity. Comparing these times with the output signals shown in 

20 FIG. 6, at times t=8.0, 8.6, and 9.2 output signal V(9i) has an amplitude of +1 and ¥(63) has 
an amplitude of -1, and at times t=8.3, t=8.9, and t=9.5 output signal V(9i) has an amplitude 
of -1 and V(93) has an amplitude of +1. 

The output signals of neural network computer 20 can be monitored by multiplying 
each output signal with a reference output signal. In the example of recognizing pattern 44 

25 from FIG. 4, the output signals of each of pixels Pi, . . Peo are multiphed with that of pixel Pi. 
The result of this multiplication is a new sixty pixel image where the image of new pixel Pi^ew 
is the product of output V(0i) with itself; the image of new pixel Psnew is the product of output 
signals V(9i) and ¥(62); the image of new pixel Ps^ew is the product of output signals V(6i) 
and V(93); the image of new pixel f^^,^^ is the product of output signals V(0i) and V(94), etc. 
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This result is illustrated in FIG. 8 where the products are shown at time intervals t=0, t=l, t=2, 
...,t-ia 

By now it should be appreciated that a method for recognizing patterns and an 
oscillatory neural network computer for implementing the method have been provided. An 
5 important aspect of this invention is the discovery by the inventors that the output signals for a 
PLL neural network computer oscillate with equal frequencies and constant^ but not 
necessarily zero, phase relationships. Thus, the phase relationships of the neural network 
computer are used to determine the connection strengths of the neural network computer. 
This provides an increased immunity to noise. Another advantage of the present invention is 

1 0 that the type of learning rule used to train the neural network computer is not a limitation of 
the present invention. 

Although certain preferred embodiments and methods have been disclosed herein, it 
will be apparent from the foregoing disclosure to those skilled in the art that variations and 
modifications of such embodunents and methods may be made without departing from the 

1 5 spirit and scope of the invention. Accordingly, it is intended that the invention shall be 
limited only to the extent required by the appended claims and the rules and principles of 
applicable law. 
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